NASA TECHNICAL NOTE 


CO 

Os 

^r 

■ 



NASA TN D-4930 


d,J 


RETURN !□ 
(WLIL-2) uj 
KIRTLAND AFB, N ME) tr 

Ln 


COPY: 
AFWL 


<s. 

oo 


THE LOG-A-POSTERIORI 
PROBABILITY METRIC FOR 
USE IN SEQUENTIAL DECODING 

by T. V. Saliga 

Goddard Space Flight Center 
Greenbelt, Md. 


NATIONAL AERONAUTICS AND SPACE ADMINISTRATION 


WASHINGTON, D. C. 


APRIL 1969 


TECH LIBRARY KAFB, NM 



TECH LIBRARY KAFB, NM 



0131bbS 

NASA TN D-4930 


THE LOG- A - POST E RIORI PROBABILITY METRIC 
FOR USE IN SEQUENTIAL DECODING 

By T. V. Saliga 

Goddard Space Flight Center 
Greenbelt, Md. 


NATIONAL AERONAUTICS AND SPACE ADMINISTRATION 


For sale by the Clearinghouse for Federal Scientific and Technical Information 
Springfield, Virginia 22151 — CFSTI price $3.00 




ABSTRACT 


Convolutional encoding with sequential decoding is one 
of the best coded communications systems available for 
spacecraft telemetry. When implementing a sequential 
decoder, a decoding confidence measure based upon the 
received signal probabilities is used. The best known 
measure is the "log-a-posteriori probability metric. 1 ’ This 
paper describes and derives this metric in detail. Tabula- 
tions of the metric for various telemetry system param- 
eters are also given. Both a continuous and a quantized 
metric are treated for various symbol signal-to-noise 
ratios on a Gaussian channel. Quantized symbol metrics 
are tabulated for 2, 4, 8, and 16 levels, and it is shown that 
the quantized LAP metric is an approximation of the ideal 
continuous metric. 
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THE LOG-A-POSTERIORI PROBABILITY METRIC 
FOR USE IN SEQUENTIAL DECODING 


by 

T. V. Saliga 

Goddard Space Flight Center 


INTRODUCTION 

During sequential decoding on a continuous, binary-symbol, communications channel, each re- 
ceived symbol has two weights. One weight is a measure of confidence that a binary "1” was trans- 
mitted, and the other is a measure of confidence that a binary "0" was transmitted. If the weights 
are proportional to the symbol's matched- filter correlation voltage, then the decoder is said to use 
a "correlation metric." A better measure, however, is one in which the weights are proportional to 
the probability that a 1 or 0 was sent, given the correlation voltage (References 1 and 2). This is 
called an "a-posteriori-probability metric," and variations of it are among the best known for use 
in sequential decoding. 

Since the sequential decoding technique itself is well described in the literature, no attempt is 
made to do so here. It is sufficient to say that a sequential decoder, whether it be implemented 
with a general-purpose computer or special-purpose hardware, must store a metric table for use 
by the decoding algorithm, and that the decoders performance is sensitive to the choice of this 
metric. 

When an engineer attempts to implement a sequential decoder, he finds that the log-a-posteriori- 
probability (LAP) metric is only briefly described in the literature. No derivations are given, and 
only the metric for a particular set of conditions is given. This paper provides a complete step- 
by-step derivation of the LAP metric, and tabulations of the metric are given for a variety of 
symbol signal- to -noise ratios and quantization levels. Furthermore, it is shown graphically that 
the quantized LAP metric is an approximation to the continuous metric. 

In the following paragraphs, the channel characteristics for a space data modem are defined, 
and the LAP metric is derived for a memory-less channel with arbitrary noise probability densi- 
ties and for the continuous LAP metric assuming a gaussian noise channel. Because an A- to-D con- 
version is ordinarily performed at the receiver, a quantized LAP metric is described and tabulated. 
This quantized metric is then compared with the continuous metric. Finally, system operation and 
the behavior of the decoder’s branch metric are described with a specific example. 
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THE CHANNEL MODEL 


The mathematical model of the communications channel assumed is shown in Figure 1. 

For each data symbol d. entering the encoder, M v" binary symbols are transmitted. The trans- 
mitter sends plus or minus /§ volts for a 1 or 0 symbol, respectively. The modulation power 


SOURCE 

DATA 

4 

1 or 0 

ruu 



Qi 


Figure 1 —Communications system model. 

is then S watts. Additive noise n(t) has N 0 watts per Hz single-sided power spectral density. 

A gain-controlled amplifier in the receiver maintains a constant signal amplitude into the 
filter. The matched filter is sampled at the end of a symbol period, giving a correlation 
voltage c i . . 

Indices Tl i" and Tt j" denote the j th symbol associated with the i th data bit. The correlation 
C i3 is a continuous, random variable because of the additive gaussian noise. 

Given each C. , the decoder hypothesizes the transmission of a 1 or 0. Let x denote this hypo- 
thesis; the symbol metrics M c (x I C..) are then summed by the decoder to compute a branch metric. 
It is impractical to use continuous values in a digital machine; therefore the C.. correlations are 
usually digitized. Using more than about 16 levels (4 bit A-to-D) gains little in system perform- 
ance (Reference 2). The quantized correlations are then used to find the quantized metric 

m(xI qJ. 
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CHANNEL CONDITIONAL PROBABILITIES 


The symbol’s correlation voltage C.. will have a gaussian probability density since the re- 
ceiver’s amplifier and filter are linear devices. The mean-to- standard deviation ratio of C*. is 
shown in Appendix A to be 


a 

a 



(i) 


where 

jjl = mean value of c.. , 

cr = standard deviation of C. . , 

S = modulation power in watts, 

T s = duration of binary symbol in sec, 

N 0 = noise density of n(t) in watts per Hz. 

If Xij is a binary 1, then fx is some positive voltage; when x L . is a 0, then fx is the same voltage 
of negative value. Let the gain-controlled amplifier adjust this voltage magnitude to 1 volt. Then 
the conditional densities of c. are 



Figure 2— Conditional probability densities for the 

THE SEQUENTIAL DECODER LAP METRIC symbol matched-filter samples. 

A sequential decoder is basically a conditional probability computer. In its algorithmic search 
for the correct path or branch in the coding tree, it computes the probability that the hypothesized 
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symbols x. . could have been transmitted, given the received c.. . This conditional branch prob- 
ability is 


P C 


, v x i, i 1 


k , vj 




"1, 2 ’ 


, vj j 


(4) 


where 

x. . = the binary symbols hypothesized by the decoder for this branch, 
k = the number of information bits shifted into the encoder to generate the branch, 
v = the number of encoder symbols transmitted per input information bit, and 

C.. = the received symbol correlation voltages. 

To simplify notation, replace the x ij and C £j sequences in Equation 4 with X n and C n , respec- 
tively. The "n” subscript represents a one-dimensional serial ordering of the sequences and 
furthermore implies n = kv. Using the same notation, X n represents the actual transmitted se- 
quence of kv binary symbols. The conditional branch probability, using hypothesized symbols, is 

- p ( x n I C n ) . (5) 

Equation 5 is the hypothesized rf a-posteriori branch probability," which is a measure of con- 
fidence that X n - X n . For v ^2, a large k, and not-too-high noise, we expect p(x n | C n ) to be near 
unity only if X n = X n . Otherwise, it should be small for "good" convolutional codes. An optimum 
decoder selects X n so as to maximize this probability. 

The a-posteriori branch probability for true transmitted sequence X n may be found using Bayes 
Theorem: 


P ( X n' Cj _ P(C„ |X„)P(X n ) 

P (0 _ P ( C n) 


(6) 


Since the channel model has no memory from symbol to symbol, the symbol probabilities are 
independent. Thus, the sequence conditional probability in Equation 6 may be expressed as the 
product of the symbol probabilities: 


P ( C „ I X n) P (*n) 

P ( C J 


m=n-kv 

p ( x j n 


m= 1 


p( c J X J _ 
p( c J 


(7) 
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The P(x n ) is just the branch probability. Each branch is a-priori equiprobable with random 
data, and there are 2 k unique branches in an n(= kv) symbol code tree. Therefore, 

P( X J = 2~ k • (8) 

To simplify the decoder’s implementation, an additive measure of probability is desirable. 

The logarithm (base = 2) of p(x n | C n ) allows this without disturbing the monotonic nature of the 
conditional probability. Note that very small branch probabilities become large negative numbers. 

Combining Equations 6, 7, and 8; taking the logarithm; and using the double subscript symbol 
indexing gives 


lo e 2 P( x J C n) 


- k + 



p( c ii I x ij) 
Pfcii) 


Of course, the actual x.. sequence is not known, and the decoder must hypothesize these sym- 
bols x.. so as to maximize this probability. Thus, substituting x.. and letting k = kv/v so that it 
may be combined in the summation gives 


k 

l0 g2 P ( X J C „) = 22 

i=l 


p( c ii 1 x ij) 
_ p( c ii) 

i 


" Symbol iJAP Metric 


Node LAP Metric 


y. 

Branch LAP Metric 


(9) 


Thus, the decoder computes the symbol-log-a-posteriori probability metrics and sums them 
over a node (= v symbols). Information bit hypotheses are based on this node metric. The sum of 
the node metrics then forms the branch LAP metric. 

The quantity 


log 2 


p(C | x) 

p (CT 


in Equation 9 is called the mutual information between x and c, and the quantity 1/v is the convo- 
lutional code rate. The channel conditional probabilities, p(C | x = 1) and p(C | x =0), were given 
in the paragraph entitled Channel Conditional Probabilities. 

Define 


. p( c 1 X) A 

i0g 2 p(C) = I ( X > C ) 


( 10 ) 
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and the continuous symbol LAP metric = M c (x | c. .) ; then it follows that 

= 1(2.^) - 1 ■ (ii) 

It is clear from Equation 11 that it is only necessary to evaluate l(x, C) for the channel. The 
symbol metric M c may be found then for any code rate by simply subtracting 1/v . 


THE CONTINUOUS SYMBOL LAP METRIC 

The symbol LAP metric M c (x | c. ) is a continuous function of C. As noted earlier, it is 
easier to implement when digitized to as few bits as possible. However, it is useful to compare 
the continuous metric to the quantized metric to see how "close” the latter approximates it. 

Define x 0 to mean x = 0 and x l to mean x = 1; then using Equation 10, 

_ p( c i _ p( c i x i ) 

1 ' C 1082 P(C) 1062 p( c I X 0 ) p( x o) +p( c I x i) p(x x ) 

For random data and linear parity check codes, it is generally true that p(x 0 ) = p(x t ) 7 1/2. 
Therefore, 


i( Xl ,c) 


log 2 


p( C I x o) 

p ( c I X 1 ) 


Likewise, 


I ( x o> C) 


log 2 


p( c I x l) 
p( C I x 0 ) 


+ 1 • 


Using the conditional densities, Equations 2 and 3, 


1 ( x i ’ c ) 



( 12 ) 


(13) 


( 14 ) 
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Similarly, 


1 ( x 0 ’ c )' ~ 1 - 1 o b 2 [ ex p ( + ~r) + x ] ' ( 15 ) 

Since I (x 0 , c) = l(x 1 , - C ) , it is only 
necessary to calculate l(x 1 , c ) . With m = 1 
volt, then o- = (2 ST s/ /n o )~ 1/2 (from Equa- 
tion 1), and finally, 


1 ( x i . c ) - 1 ~ l°g 2 


ST^ 

exp 4C ) + 1 


(16) 


Figure 3 is a plot of Equation 16 for ST s /N 0 
values useful for v = 2 and 4 codes. Ap- 
pendix B is a tabulation of Equation 16 for 
ST s /n o values of -6 db through +3 db. 



THE QUANTIZED SYMBOL METRIC 


Figure 3— The continuous symbol metric 
for several $T s /N 0 ratios. 


As shown in Figure 1, an A-to-D conversion of a symbol correlation C gives rise to a number 
Q representing one of a set of 2 M quantiles of c. The quantized symbol LAP metric is defined on Q 
as 


M(x ;j 


Qii) 


log. 


p(Q ;j I «!,) 


p (Qii) 


1 

v 


(17) 


This is similar to Equation 9, but is a ratio of quantile probabilities rather than densities. A 
result analogous to Equation 12 can be readily obtained: 


i(*i-Q) 


i°g 2 


p(Q I x o) 

p(qK ) +1 


(18) 


where, 


P(Q|Xi ^ = J q 7 ^ exp {' [ z+M ( x ^]/ 2CT2 } dz 


7 



and 


^( x i) 


[+1 if x. = x. 


l “ 1 if x . 


finally, 


M(x | Q) = l(x, C) - “ ■ (19) 

Before calculation can proceed, there are several practical questions that must be 
answered: 

1. How many A-to-D bits (m) should be used? 

2. Over what range of C should the quantization levels be distributed? 

Jacobs has shown (Reference 2) that the signal-to-noise ratio (SNR) loss between the use of 
16 levels and an infinite number is under 0.1 db. The use of only two levels, however, incurs a 
2-db loss. Selecting the number of levels is a system design problem. The metric is found in 
this paper for 2, 4, 8, and 16 levels. 



— p/2 



FOUR LEVELS (m = 2) 



EIGHT LEVELS (m = 3) 


|l6l 15 Il4l 13 iTij 1 1 |To1 9 

SIXTEEN LEVELS (m = 4) 

Figure 4— Quantile assignment nomogram. 
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Assigning the optimum level is difficult, 
since the exact cost function for the decoder’s 
performance is not known. The assignments 
selected for this paper were chosen to give a 
good approximation to the continuous metric 
over all C where p(C) was non-negligible. It 
is known from previous simulations that the 
level assignments are not critical.* Figure 4 
summarizes the assumptions made. Note that 
the 8- and 16-level assignments are a function 
of cr and hence of the particular symbol SNR 
selected. The ordinary A-to-D converter con- 
straint of equally spaced quantization intervals 
is assumed. 

Table 1 lists the quantized mutual infor- 
mation, l(x 1 , Q) , for four symbol SNR’s. Us- 
ing Equation 19, the LAP metric may be easily 
found, given the code rate. 


* Private communication with G. David Forney, Jr., October 1967. 
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Table 1 


Quantized Mutual Information, I(x = 1, Q), Tabulation 
(See Figure 3 for quantile assignments). 



ST,/N C 

, = -4 db 


ST s /N 0 

= -1 db 


Quantile 

Number, 

Q 

M = 1, < 

cr = 1.121 


1 

II 

x = 0.793 


Number of Levels 


Number of Levels 


2 

4 

8 

16 

2 

4 

8 

16 

1 

0.703 

0.255 

0.340 

0.201 

0.843 

0.450 

0.510 

0.311 

2 

-1.42 

0.818 

0.743 

0.510 

-2.38 

0.944 

0.908 

0.702 

3 


-0.31 

0.908 

0.712 


-0.66 

0.985 

0.881 

4 


-2.07 

0.976 

0.835 


-3.70 

0.998 

0.954 

5 



-0.45 

0.908 



-0.80 

0.983 

6 



-1.61 

0.948 



-3.02 

0.993 

7 



-3.02 

0.972 



-5.56 

0.998 

8 



-4.91 

0.989 



-8.53 

0.999 

9 




-0.23 




-0.40 

10 




-0.80 




-1.42 

11 




-1.47 




-2.66 

12 




-2.21 




-4.00 

13 




-3.01 




-5.39 

14 




-3.84 




-6.79 

15 




-4.69 




-8.21 

16 




-6.04 




-10.17 


ST s /N 0 = Odb 


ST s /N ( 

5 = +3 db 



M = 1, 

o- = 0.707 


U = 1, 

CT = 0.501 


1 

0.992 

0.532 

0.578 

0.358 

0.966 

0.788 

0.788 

0.539 

2 

-2.67 

0.968 

0.945 

0.767 

-4.45 

0.997 

0.994 

0.925 

3 


-0.85 

0.994 

0.923 


-1.87 

0.999 

0.989 

4 


-4.52 

0.999 

0.975 


-8.27 

1.000 

0.998 

5 



-0.98 

0.992 



-1.87 

0.999 

6 



-3.73 

0.996 



-7.01 

1.000 

7 



-6.80 

0.999 



-12.38 

1.000 

8 



-10.26 

1.00 



-18.04 

1.000 

9 




-0.47 




-0.87 

10 




-1.75 




-3.31 

11 




-3.26 




-6.06 

12 




-4.88 




-8.88 

13 




-6.54 




-11.70 

14 




-8.21 




-14.53 

15 




-9.89 




-17.35 

16 




-12.12 




-20.71 


The symbol SNR’s, ST s /n 0 , in Table 1 have been selected especially for rate 1/2 and 1/4 codes. 
With the E bit /n 0 * decoding thresholds defined as 3 db and 2 db for rate 1/2 and 1/4 codes respec- 
tively, the corresponding symbol SNR’s are as follows: 


Threshold Threshold +3 db 


(i/2 

code rate/ 

11/4 


0 db 

3 db 

-4 db 

-1 db 


Since most operational telemeters nor- 
mally operate above the system’s threshold, 
SNR’s 3 db above threshold are also given. 

COMPARISON OF CONTINUOUS 
AND QUANTIZED METRICS 

If the quantized metric is superimposed on 
the continuous metric, as shown in Figure 5, it 
is apparent that the quantized metric is a good 
stepwise approximation to the continuous met- 
ric. 1 Should a quantized metric be desired 
with different SNR’s, etc., one could readily 
use a graphical approximation to the continuous 
metric. 

TYPICAL METRIC BEHAVIOR 
IN A SEQUENTIAL DECODER 



Figure 5— Comparison of continuous and 8-level 
quantized mutual information (ST s /N 0 - 0 db). 


For a better appreciation of the behavior of a sequential decoder’s branch metric when de- 
coding a noisy signal, an example is given, based upon a computer simulation of a decoding system.* 
This example consists of a time record of system parameters during the propagation of seven in- 
formation bits through the encoder, channel, filter, and decoder. 


An 8-level, quantized LAP metric is assumed; its assumptions and values are listed in Table 2. 
For efficient computer implementation, integer metric table values are desired. The M(X | Q) 
values have been multiplied by 20, and the nearest integer value taken as the table value. 

A time record of a rate 1/2 convolutional coded-sequential decoded system using this metric 
is shown in Figure 6. Each data bitd. that enters the system causes two symbols to be transmitted, 


♦Egjx/^o = Received energy per information bit/noise power spectral density. 

^Metric and mutual information are used interchangeably since their only difference is the addend “l/v. 

■^Saliga, T. V., "A Comparison of Sequential Decoding Metrics by Computer Simulation,” to be published as a NASA Technical Report, 


1968. 
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Table 2 


Metric Table for Example (8 -Level LAP Metric for (j,/cr - /2 or ST s /N 0 = 0 db). 


M(x = 0 | Q) 

Decoder 
Table Value 

Q 

M(x = 1 | Q) 

Decoder 
Table Value 

-1.48 

-30 

1 

0.078 

2 

-4.23 

-85 

2 

0.445 

9 

-7.3 

-146 

3 

0.494 

10 

-10.76 

-216 

4 

0.500 

10 

0.078 

2 

5 

-1.48 

-30 

0.445 

9 

6 

-4.23 

-85 

0.494 

10 

7 

-7.3 

-146 

0.500 

10 

8 

-10.76 

-216 


data , 

RATE 1/2 

A 

ENCODER 




Node 

or 

bit no. 
i 

Data bit 

Coder 
output , 
x ii 

Correlator output 
without noise 
(V~ L5v) 

Actual correlator 
output 

c <i 

Quanti le 
number , 

Q ii 

Symbol 
metrics 
given X - 

Decoder's 
best 
guess , 

x ii 

Branch 
metric for 
best guess 
path 

0 

1 

i 

d, = i 

X,.,- ' 

+ 1.5 

Cii= 1.89 

3 

-146 

10 

1 

10 



X 1.2 = 1 

+ 1.5 

C 12 = 2.02 

3 

-146 

10 

1 

20 

2 

d 2 = ° 

X 2., “ 0 

-1.5 

C 2i — — 1 .64 

6 

9 

-85 

0 

29 



1 

+ 1.5 

-0.08 

5 

2 

-30 

1 

- 1 

3 

0 

0 

- 1 .5 

-3.57 

8 

10 

-216 

0 

9 



0 

-1.5 

-0.07 

5 

2 

-30 

0 

11 

4 

0 

0 

-1.5 

-1.78 

7 

10 

-146 

0 

21 



1 

+ 1.5 

2.30 

3 

-146 

10 

1 

31 

5 

0 1 

0 

-1.5 

-1.97 

7 

10 

-146 

0 

41 



0 

-1.5 

0.44 

1 

-30 

2 

0 

11 

6 

1 

1 

+ 1.5 

0.32 

1 

-30 

2 

1 

13 



X 6,2 = 0 

- 1.5 

C 6 . 2 = 0.21 

1 

-30 

2 

0 

-17 

7 

etc . 










Figure 6— Operation analysis example 





x. l and x. 2 . This in turn yields a pair of 
symbol correlation voltages, c. t andC £ 2 . 
Each of these A-to-D converted values, Q i A 
andQ i 2 , interrogates the metric table for a 
pair of metric values. Depending on the de- 
coders algorithm and encoder’s connections, 
two metric values are summed to form a 
node metric for ad. = 1 hypothesis. Simi- 
larly, the alternate metric pair are summed 
to form the node metric for the d i = 0 hy- 
pothesis. The ’’best guess" node metric is 
added into an accumulator to form the cur- 
rent branch metric, and its associated data 
bit d. is stored in a local .data register. 

A plot of the behavior of the branch LAP 
metric versus bit number is shown in Fig- 
ure 7. If no bit errors are made and the 
noise is not too large, then the branch met- 
ric will increase slowly with "i". With one 
or more bit errors, it will tend to decrease 
rapidly in value as "i" increases. 

CONCLUSIONS 



Figure 7 — Branch metric behavior with a noisy signal. 


A sequential decoder’s performance is quite sensitive to the choice of a metric.* Should a 
proposed system have channel amplitude statistics significantly different from gaussian, then a 
new metric table should be found using general results (Equations 11, 12, 13, 17 and 18). This 
should insure that the decoder’s error probability and overflow probabilities are low. 

The author is not aware of any proof that the LAP metric is the best metric to use in a se- 
quential decoder. However, it is the best of the known metrics. 


Goddard Space Flight Center 
National Aeronautics and Space Administration 
Greenbeit, Maryland, August 16, 1968 
861-51-75-01-51 


*SaIiga, T. V., "A Comparison of Sequential Decoding Metrics by Computer Simulation,” to be published as a NASA Technical Report, 
1968. 
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Appendix A 

Statistics at Output of a PCM Matched Filter 


It is well known that a matched filter and a cross-correlator have identical output signal-to- 
noise ratios when the correlator's local signal is a replica of the transmitted waveform. For this 
derivation, a synchronous subcarrier, PCM signal source is assumed. A white, additive, gaussian 
noise channel and a loss-less symbol correlator are also assumed. Figure A1 is a diagram of the 
communications system model. A loss-less, linear, RF modem is assumed but is not shown ex- 
plicitly. It is not really necessary to include the subcarrier modem since it does not affect the 
results. However, it is included just to emphasize that point. 

The following definitions apply to this appendix as well as the body of the paper. 

x(t) = the serial NRZ-PCM binary digit source signal, 

f s = the subcarrier clock which is synchronous with x(t), 


H (- T s SEC 


NRZ - PCM 


i — i » r 


i 

o 



♦ 

C VOLTS 

I 


J 


SYMBOL MATCHED FILTER 


Figure Al— Signal, channel, and matched -filter models. 
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T s = duration of a binary symbol x in seconds, 
s = signal power in watts, 

n(t) = the additive channel noise; it is stationary, white, and gaussian with spectral density 
N 0 watts per Hz, and has zero mean, 

K = the integrator’s gain constant in sec -1 , and 

c = the symbol correlation voltage at t > T s in volts. 

Because the noise is additive and the filter is linear, the signal and noise effects on C may be 
found separately and superposition applied. 

Signal Only 

If n(t) = 0, then C is deterministic for each x. From the model in Figure Al, it is clear that 
for the 2-cycle-per-symbol subcarrier shown or for any ’V T -cycle-per-symbol PCM subcarrier, 
"e" at the integrator input will always be of the same form (n = 1, 2, 3, . . •). Thus 


and 


C] 


X=1 



K VS T g , 


C] 


x=0 



Vsdt 


- kVs t s . 


(Al) 


(A2) 


Noise Only 

The autocorrelation function of white, gaussian noise will be needed in the derivation below. 
It is well known that the autocorrelation function and the power spectral density are a Fourier 
transform pair. Therefore, 


4>(t) 



P(f) e + i wt df 


(A3) 


where 

0(r) = the autocorrelation function of some random signal r, and 
P(f) = the power spectral density of the random signal; 
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<£(t) is defined here as 


<Kt) = E[n(t)n(t -r)] , (A4) 

where n(t) is the random signal and E( ) denotes mathematical expectation over an ensemble. 

The autocorrelation function of n(t) may be found from Equation A3 since P(f) = N 0 is known. 
Thus, 


<*> n ( T ) = 4 N 0 £ + i“'df 

■'-00 

N n 

= -5 S(r) , (A5) 

where 5(t) is the Dirac delta function. 

Now it is desired to calculate the probability density function for the fT noise alone" matched- 
filter output. The effects of the subcarrier multiplier will be considered first. The effect of the 
subcarrier multiplier on n(t) may be found formally by using the convolution theorem. However, 
it can be simply observed that since the multiplier only multiplies by +1 and -1 and n(t) is an 
infinite bandwidth signal, then the amplitude statistics of e, the product, are unchanged. The power 
spectral density N 0 is also unchanged. The noise time-sequence output from the multiplier n' (t) 
is different from n(t), but its amplitude statistics and power spectrum are unchanged. 

The effects of the integrator may now be treated. Since the integrator is a linear summation 
device and the input noise n' (t) has gaussian amplitude probability density, then the output c must 
also be gaussian. Knowing the mean and variance of C will then completely specify its statistics. 

Define C N = the matched-filter output with noise n(t) alone as input. Then, 


mean ( c n ) & E(C„ ) 



(t) dt 


and since the expectation is computed over an ensemble, 


mean (C n ) 



0 , 


(A6) 
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where 


E( ) = mathematical expectation over an ensemble of events. 


The variance of C N is by definition: 


here, and 


( c n) “ E[(C N -mean) 2 ] 


"( c h ) = e ( c n 2 ) 


(C N ) = EK n ' ( t ) dt • K n ' ( t ) dt 


The integrals may be combined provided that the integrand parameters are made distinct. Therefore 


»( c n) = E 


M'f~- 


( t ) du dt 


2 [ f E[n(u)n(t>] 

J 0 * 0 


but from Equations A4 and A5, 


E n( t ) n( t “ r)] 


Then, 


5( t - u) du dt 


K 2 N n T 


i ii i i 


an an i 


i in I i 


l I 



Filter Output Statistics With Signal and Noise 

With combined signal and noise entering the matched filter, 


mean (C) ~ mean (signal) + mean (noise) 


and 


kVs t s for x = l 

(A8) 

- Hi'S T S for X = 0 . 

(A9) 


The density of C is, of course, gaussian with variance given by Equation A7. A useful additional 
result is the mean-to-standard deviation ratio of C: 


fi 

Cr 


K^S T 





(A10) 


where 

fjL x = mean of C given x = 1, and 
a = standard deviation of C = [var (C )] 1/2 . 
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Appendix B 

Tabulation of the Symbol Mutual Information Function 


This appendix is a tabulation of the symbol mutual information function l(x = 1, C) for a num- 
ber of symbol signal -to -noise ratios. This function, or approximations to it, may then be used to 
find the "log-a-posteriori probability (LAP) metric” for use in sequential decoding of binary PCM 
signals. 

By definition, 


l(x = 1, C) 


log 2 


p(c ! x = i) . 
P(C) 


for the gaussian channel, 


I(x = l, C) 


log. 


(«■ 


4C ST s /N q 


+ 1 


(Bl) 


(B2) 


where 

x = the transmitted binary symbol, 0 or 1, 

c = the symbol correlation at the output of a matched filter; E(C I x M) = 1 volt is assumed, 
S = transmitted modulation power in watts, 

T s = duration of a symbol in sec, and 
N 0 = noise density in watts per Hz. 

Because of symmetry, it follows that 


I(x = 0, C) = I(x = 1, - C) ; 


therefore, only Equation B2 is tabulated in Table Bl. 

Finally, the LAP metric is found as 

M c (x | C) = I(x, C) - i • 
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where 


v = the number of binary symbols transmitted by the encoder for each information bit entered 
into the encoder. 


Table B1 


I(x = 1, C) vs. C. 


c 

in 

Volts 




ST s /N 0 in db; d 


10 (ST s /N 0 ) 



-6 

-5 

-4 

-3 

-2 

-1 

0 

1 

2 

3 

3.00 

0.931 

0.968 

0.988 

0.996 

0.999 


1.000 

1.000 

1.000 

1.000 

2.80 

0.916 

0.959 

0.983 

0.995 

0.999 


1.000 

1.000 


1.000 

2.60 

0.898 

0.947 

0.977 

0.992 

0.998 

1.000 

1.000 

1.000 


1.000 

2.40 

0.876 

0.932 

0.969 

0.988 

0.997 

0.999 

1.000 

1.000 


1.000 

2.20 

0.850 

0.913 

0.957 

0.983 

0.994 

0.999 

1.000 

1.000 


1.000 

2.00 

0.818 

0.889 

0,941 

0.974 

0.991 

0.997 

1.000 

1.000 


1.000 

1.80 

0.781 

0.859 

0.920 

0.961 

0.985 

0.995 

0.999 

1.000 


1.000 

1.60 

0.736 

0.821 

0.891 

0.943 

0.975 

0.991 

0.998 

1.000 

1.000 

1.000 

1.40 

0.683 

0.773 

0.852 

0.915 

0.958 

0.983 

0.995 

0.999 

1.000 

1.000 

1.20 

0.621 

0.714 

0.801 

0.875 

0.932 

0.968 

0.988 

0.997 

0.999 

1.000 

1.00 

0.549 

0.641 

0.732 

0.817 

0.889 

0.941 

0.974 

0.991 

0.997 

1.000 

0.80 

0.465 

0.552 

0.644 

0.735 


0.891 

0.942 

0.975 

0.991 

0.998 

0.60 

0.369 

0.445 

0.530 

0.621 

0.713 

0.800 

0.875 

0.931 

0.968 

0.988 

0.40 

0.260 

0.318 

0.387 

0,465 

0.551 

0.643 

0.734 

0.819 

0.890 

0.942 

0.20 

0,136 

0.170 

0.210 

0.259 

0.318 

0.386 

0.464 

0.550 

0.642 

0.733 

- 0.00 





- 0.000 


- 0.000 

- 0.000 



- 0,20 

- 0.154 

- 0.196 

- 0.250 

- 0.320 

- 0.412 

- 0.532 

- 0.692 

- 0.905 

- 1.190 

- 1.573 

-0.40 

- 0.321 

- 0.413 

- 0.534 

- 0.694 

- 0.908 

- 1.194 

- 1.578 

- 2.092 

- 2.774 

- 3.671 

- 0.60 

- 0.502 

- 0.652 

- 0.851 

- 1.118 

- 1.475 

- 1.955 

- 2.593 

- 3.435 

- 4.528 

- 5.932 

- 0.80 

- 0.696 

- 0.910 

- 1.197 

- 1.582 

- 2.098 

- 2.782 

- 3.682 

- 4.847 

- 6.338 

- 8.229 

- 1.00 

- 0.903 

- 1.187 

- 1.569 

- 2.079 

- 2.758 

- 3.650 

- 4.806 

- 6.286 

- 8.163 


- 1.20 

- 1.121 

- 1.480 

- 1.961 

- 2.601 

- 3.445 

- 4.541 

- 5.948 

- 7.735 

- 9.994 

- 12.839 

- 1.40 

- 1,349 

- 1.786 

- 2.369 

- 3.140 

- 4.147 

- 5.445 

- 7.097 

- 9.188 

- 11.825 

- 15.146 

- 1.60 

- 1.587 

- 2.104 

- 2.791 

- 3.692 

- 4.860 

- 6.355 

- 8.250 

- 10.643 

- 13.657 

- 17.452 

- 1.80 

- 1.833 

- 2.431 

- 3.222 

- 4.253 

- 5.580 

- 7.269 

- 9.405 

- 12.098 

- 15.489 

- 19.759 

- 2.00 

- 2.086 

- 2.766 

- 3.661 

- 4.820 

- 6.303 

- 8.185 

- 10.560 

- 13.553 

- 17.321 


- 2.20 

- 2.344 

- 3.108 

- 4.105 

- 5.391 

- 7.029 

- 9.102 

- 11.716 

- 15.009 

- 19.154 

- 24.372 

- 2.40 

- 2.609 

- 3.455 

- 4.554 

- 5.964 

- 7.756 

- 10.020 

- 12.872 

- 16.464 

- 20.986 

- 26.678 

- 2.60 

- 2.877 

- 3.805 

- 5.006 

- 6.540 

- 8.484 

- 10.938 

- 14.028 

- 17.919 

- 22.818 

- 28.985 

- 2.80 

- 3.149 

- 4.159 

- 5.460 

- 7.116 

- 9.213 

- 11.856 

- 15.184 

- 19.374 

- 24.650 

- 31.291 

- 3.00 

- 3.425 

- 4.516 , 

- 5.915 

- 7.694 

- 9.942 

- 12.774 

- 16.340 

- 20.830 

- 26.482 1 

- 33.598 
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